Reading support system and moving body

ABSTRACT

According to one embodiment, a reading support system includes a processing device. The processing device includes an extractor and a type determiner. The extractor extracts a plurality of regions from a candidate region. The candidate region is a candidate of a region in which a meter is imaged. The regions respectively include a plurality of characters of the meter. The type determiner determines a type of the meter based on positions of the regions.

CROSS-REFERENCE TO RELATED APPLICATIONS

This is a continuation application of International ApplicationPCT/JP2019/037258, filed on Sep. 24, 2019. This application also claimspriority to Japanese Patent Application No. 2018-232730, filed on Dec.12, 2018. The entire contents of each are incorporated herein byreference.

FIELD

Embodiments described herein relate generally to a reading supportsystem and a moving body.

BACKGROUND

There is a system used to read a value (an indication) of a meter. It isdesirable for the system to perform processing that can read theindication with higher accuracy.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram illustrating the configuration of a readingsupport system according to a first embodiment;

FIGS. 2A to 2D, FIGS. 3A to 3C, FIGS. 4A and 4B, FIGS. 5A to 5C, FIGS.6A to 6D, FIGS. 7A to 7D, FIG. 8, FIGS. 9A to 9C, FIGS. 10A to 10C, FIG.11, and FIG. 12 are schematic views illustrating meters;

FIGS. 13 to 16 are flowcharts illustrating the processing according tothe reading support system according to the first embodiment;

FIG. 17 is a block diagram illustrating a configuration of a readingsupport system according to a second embodiment;

FIG. 18 is a block diagram illustrating a configuration of a readingsupport system according to a third embodiment;

FIG. 19 is a schematic view describing an operation of the readingsupport system according to the third embodiment; and

FIG. 20 is a block diagram illustrating a hardware configuration of thereading support systems according to the embodiments.

DETAILED DESCRIPTION

According to one embodiment, a reading support system includes aprocessing device. The processing device includes an extractor and atype determiner. The extractor extracts a plurality of numeral regionsfrom a candidate region. The candidate region is a candidate of a regionin which a meter is imaged. The numeral regions respectively include aplurality of characters of the meter. The type determiner determines atype of the meter based on positions of the numeral regions.

Various embodiments are described below with reference to theaccompanying drawings.

In the specification and drawings, components similar to those describedpreviously or illustrated in an antecedent drawing are marked with likereference numerals, and a detailed description is omitted asappropriate.

First Embodiment

FIG. 1 is a block diagram illustrating the configuration of a readingsupport system according to a first embodiment.

FIGS. 2A to 2D are schematic views illustrating meters.

FIGS. 3A to 12 describe processing according to the reading supportsystem according to the first embodiment.

The reading support system 1 is used when reading a value (anindication) shown by a meter from an image including the meter. The typeof the object meter is arbitrary. For example, the reading supportsystem 1 may be used to read the indications of round meters M1 and M2such as those illustrated in FIGS. 2A and 2B. A round meter includes apointer In rotating with some point as the center, multiple graduationsSc marked around the center point, and numerals Nu marked to correspondto at least a portion of the multiple graduations Sc. The graduations Scare arranged in a circular configuration or a circular arc-likeconfiguration. The round meter shows a value by the pointer Inindicating a designated graduation Sc by one of the pointer In or thegraduations Sc rotating along the arrangement direction of thegraduations Sc.

The reading support system 1 also can be used to read the indication ofa vertical meter M3 such as that illustrated in FIG. 2C or a horizontalmeter M4 such as that illustrated in FIG. 2D. Vertical meters andhorizontal meters include the pointer In, the multiple graduations Scarranged in one direction, and the numerals Nu marked to correspond toat least a portion of the multiple graduations Sc. Vertical meters andhorizontal meters show a value by the pointer In indicating a designatedgraduation Sc by one of the pointer In or the graduations Sc movingalong the arrangement direction of the graduations Sc.

As illustrated in FIG. 1, the reading support system 1 according to thefirst embodiment includes a processing device 10 and a memory device 20.The processing device 10 includes an extractor 14. In the example ofFIG. 1, the processing device 10 further includes an acceptor 11, anextractor 12, a corrector 13, a reader 15, and an outputter 16.

For example, an external imaging device acquires a static image byimaging the meter. The imaging device transmits the acquired image tothe processing device 10. Or, the imaging device may store the image inthe memory device 20. The processing device 10 acquires the image byaccessing the memory device 20. A video image may be imaged by theimaging device. For example, the imaging device cuts out a static imagefrom the video image and transmits the static image to the processingdevice 10 or the memory device 20. An object other than the meter may beimaged in the image.

The acceptor 11 accepts the image input to the processing device 10. Theacceptor 11 outputs the image to the extractor 12. FIG. 3A is an exampleof the image input to the processing device 10.

From the input image, the extractor 12 extracts a candidate of theregion in which the meter is imaged. Here, the image that is imaged bythe imaging device and input to the processing device 10 is called theinput image. A portion of the input image that is a candidate of theregion in which the meter is imaged is called a candidate region.Multiple candidate regions may be output from the extractor 12.

As one specific example, the extractor 12 includes a contour extractor12 a and a selector 12 b.

For example, the contour extractor 12 a extracts contours (edges)included in the input image based on the brightness difference or theluminance difference of the input image. The contour extractor 12 a alsomay perform processing of the input image as appropriate when extractingthe contours. For example, the contour extractor 12 a may convert theinput image into grayscale, subsequently binarize the image, and extractthe contours from the binary image.

The selector 12 b extracts a region surrounded with a contour from theinput image. For example, the selector 12 b compares the maximum lengthin some one direction and the surface area to preset thresholds for theregions. The selector 12 b selects, as candidate regions, the regionsfor which the maximum length and the surface area are respectivelygreater than the thresholds. Thereby, the regions that have surfaceareas that are too small, regions having shapes much different from ameter, etc., are excluded. FIG. 3B illustrates a candidate region CR1extracted from an input image II illustrated in FIG. 3A. The selector 12b outputs the candidate region to the corrector 13.

The corrector 13 performs a projective transformation of the candidateregion as appropriate. Typically, the outer edge of the meter or theouter edge of the display panel of the meter is circular or rectangular.When the candidate region is trapezoidal, parallelogram-shaped, etc.,the corrector 13 performs a projective transformation of the candidateregion so that the outer edge of the candidate region is rectangular.When the candidate region is elliptical or oval, the corrector 13performs a projective transformation of the candidate region so that theouter edge of the candidate region is circular. The distortion of thecandidate region is corrected by the projective transformation. Thecorrector 13 outputs the corrected candidate region to the extractor 14.

The extractor 14 extracts a numeral region, a scale region, and apointer region from the candidate region. Specifically, the extractor 14includes a numeral region extractor 14 a, a type determiner 14 b, ascale region extractor 14 c, and a pointer region extractor 14 d.

The numeral region extractor 14 a extracts a character candidate, whichis a candidate of a region in which a character is imaged, from thecandidate region. The character candidate is a portion of the candidateregion. The character candidate includes a numeral, an alphabetcharacter, etc. Or, an object other than a character such as adheredmatter on the meter, noise of the image, etc., may be included in thecharacter candidate. For example, scene character recognition technologyor the like is used to extract the character candidate. The size of theextracted character candidate is determined based on the size of thecandidate region.

The numeral region extractor 14 a performs the following processing foreach of the character candidates.

First, the numeral region extractor 14 a calculates a match rate betweenthe character candidate and a numeral for each of the charactercandidates. For example, the numeral region extractor 14 a calculates,as the match rate, the similarity of a feature between the charactercandidate and a preregistered image of a numeral. Then, the numeralregion extractor 14 a performs a preset angular rotation of thecharacter candidate. The numeral region extractor 14 a recalculates thematch rate between the character candidate and the numeral for each ofthe rotated character candidates. Thereafter, the rotation of thecharacter candidate and the calculation of the match rate are repeateduntil the rotation count reaches a prescribed number or the totalrotation angle reaches a prescribed threshold.

In FIGS. 4A and 4B, the horizontal axis is a rotation angle A. Thevertical axis is a match rate R. Results such as those illustrated inFIGS. 4A and 4B are obtained by repeating the rotation of the charactercandidate and the calculation of the match rate.

FIG. 4A illustrates a result when a numeral is included in the charactercandidate. The numeral region extractor 14 a calculates the proportionof the change of the match rate with respect to the change of therotation angle from the result. For example, the numeral regionextractor 14 a determines that a numeral is included in the charactercandidate when the proportion is greater than a threshold. In theexample of FIG. 4A, the numeral region extractor 14 a determines that anumeral is included in the character candidate from the result of thecross-hatched portion.

FIG. 4B illustrates a result when a numeral is not included in thecharacter candidate. When a numeral is not included in the charactercandidate, the proportion of the change of the match rate with respectto the change of the rotation angle is small as illustrated in FIG. 4B.Based on this result, the numeral region extractor 14 a excludes thecharacter candidates that do not include a numeral from the multiplecharacter candidates. The numeral region extractor 14 a determines theminimum area surrounding the character candidate for each of thecharacter candidates determined to include a numeral.

The numeral region extractor 14 a may rotate the candidate region basedon the result of the rotation angle and the match rate. For example,when a numeral is determined to be included in the character candidate,the numeral region extractor 14 a records the angle at which the maximumvalue of the match rate is obtained. When the determination is completedfor all of the character candidates, the numeral region extractor 14 acalculates the average value of the angles. The numeral region extractor14 a rotates the candidate region by the calculated average value.

By the processing described above, for example, the minimum areas thatsurround the numerals are obtained as illustrated in FIG. 3C from theimage of the candidate region CR1 illustrated in FIG. 3B. These minimumareas each are extracted as numeral regions R1 from the candidate regionCR1. The numeral region extractor 14 a outputs, to the type determiner14 b, the extracted multiple numeral regions and the positions of thenumeral regions in the candidate region.

At this time, information that relates to the numeral regions may beoutput from the numeral region extractor 14 a to the corrector 13. Forexample, the numeral region extractor 14 a acquires a length L1 and alength L2 for at least a portion of the extracted numeral regions asillustrated in FIG. 3C and outputs the length L1 and the length L2 tothe corrector 13. For example, the corrector 13 calculates thedistortion of the candidate region based on the ratio of the length L1and the length L2 and re-performs a projective transformation of thecandidate region to correct the distortion. In such a case, theprocessing by the numeral region extractor 14 a is re-performed for thecandidate region of the projective transformation. Numeral regions thathave less distortion can be extracted thereby. A scale region and apointer region that have less distortion can be extracted in thesubsequent processing. The reading accuracy of the indication of themeter can be increased when the distortions of the numeral region, thescale region, and the pointer region are small.

The type determiner 14 b determines the type of the meter imaged in theinput image based on the positions of the numeral regions. For example,when the multiple numeral regions R1 are arranged in a curve in thecircumferential direction as illustrated in FIG. 3C, the type determiner14 b determines that the meter imaged in the input image is a roundmeter. When the numerals are arranged along one direction, the typedeterminer 14 b determines that the meter imaged in the input image is avertical meter or a horizontal meter. The type determiner 14 b outputsthe type of the meter to the scale region extractor 14 c.

The scale region extractor 14 c extracts the scale region from thecandidate region. For example, the processing by the scale regionextractor 14 c changes according to the result of the determination bythe type determiner 14 b. Specifically, when the type of the meter isdetermined to be round, the scale region extractor 14 c performs a polartransformation of the candidate region. For example, when the candidateregion is circular, the center of the circle is used as the center ofthe polar coordinate system. When the candidate region is rectangular,the intersection of the diagonal lines is used as the center of thepolar coordinate system. The polar transformation of the candidateregion is performed after setting the center of the polar coordinatesystem.

When the meter is round, the graduations are arranged in thecircumferential direction in the candidate region. In the candidateregion after the polar transformation, the graduations are arranged insubstantially one direction. When the type of the meter is vertical orhorizontal, a polar transformation of the candidate region is notperformed. This is because the graduations are already arranged in onedirection in vertical meters and horizontal meters. FIG. 5A illustratesa result of a polar transformation of the candidate region CR1 of FIG.3B.

For example, the scale region extractor 14 c binarizes a candidateregion CR2 after the polar transformation illustrated in FIG. 5A. Asillustrated in FIG. 5B, a binarized candidate region CR3 is obtainedthereby. The scale region extractor 14 c extracts contours from thebinarized candidate region CR3. As illustrated in FIG. 5C, a candidateregion CR4 in which the contours are enhanced is obtained thereby.

The scale region extractor 14 c sets multiple first subregions SRA asillustrated in FIG. 6A for the image in which the contours areextracted. The multiple first subregions SRA are arranged in a firstdirection D1. The length of the first subregion SRA in a seconddirection D2 perpendicular to the first direction D1 is, for example,equal to the length in the second direction D2 of the candidate regionCR4. For example, the number of the first subregions SRA that are set isdetermined based on the size of the candidate region. In the example ofFIG. 6A, ten first subregions SRA1 to SRA10 are set.

When the meter is round, the first direction D1 corresponds to thediametrical direction before the polar transformation. The diametricaldirection is the direction from the center of rotation of the meter orthe graduation toward the graduations. The second direction D2corresponds to the circumferential direction. The circumferentialdirection is the direction in which the graduations are arranged. Thescale region extractor 14 c counts the number of horizontal lines ineach of the first subregions SRA. Here, a horizontal line refers to aline extending in the first direction D1.

FIG. 6B is an enlarged image of a portion P1 illustrated in FIG. 6A.FIG. 6C is an enlarged image of a portion P2 illustrated in FIG. 6A.Here, the black and white of the image of FIG. 6A are inverted forconvenience of description in FIGS. 6B and 6C. For example, asillustrated in FIGS. 6B and 6C, the scale region extractor 14 c setsmasks Ma in each of the first subregions SRA. For example, the masks Maare set so that the length in the second direction D2 of the regions notcovered with the masks Ma has a specified value. The scale regionextractor 14 c confirms whether or not contours are in the regions notcovered with the masks Ma. When a contour exists, the scale regionextractor 14 c measures the length in the first direction D1 of thecontour. When the length in the first direction D1 is greater than aprescribed threshold, the contour is determined to be a horizontal line.For example, in the example illustrated in FIG. 6B, a contour E1 betweenthe masks Ma is not determined to be a horizontal line. In the exampleillustrated in FIG. 6C, contours E2 and E3 between the masks Ma aredetermined to be horizontal lines. The scale region extractor 14 ccounts the number of horizontal lines in each of the first subregionsSRA while changing the positions of the masks Ma.

The scale region extractor 14 c totals the number of horizontal lines ineach of the first subregions SRA. For example, the result illustrated inFIG. 6D is obtained from the image illustrated in FIG. 6A. FIG. 6Dillustrates a total Sum of the number of horizontal lines at each ofmultiple points in the first direction D1. From this result, the scaleregion extractor 14 c determines the first subregions in which the totalnumbers of the horizontal lines are greater than the prescribedthreshold to be areas (scale areas) in which the graduations of themeter exist. In the example of FIG. 6D, the scale region extractor 14 cdetermines the positions of the first subregions SRA8 to SRA10 shown bycross hatching to be the scale area. The scale region extractor 14 cextracts the scale area from the candidate region based on thedetermination result. For example, by this processing, a scale area SAillustrated in FIG. 7A is extracted from the image illustrated in FIG.5A.

For example, as illustrated in FIG. 7B, the scale region extractor 14 csets multiple second subregions SRB in the scale area SA in which thecontours are extracted. The multiple second subregions SRB are arrangedin the second direction D2. In the example of FIG. 7B, nine secondsubregions SRB1 to SRB9 are set. Similarly to the totaling calculationof the number of horizontal lines of each of the first subregions SRAdescribed above, the scale region extractor 14 c totals the number ofhorizontal lines for each of the second subregions SRB.

For example, the result illustrated in FIG. 7C is obtained from theimage illustrated in FIG. 7B. FIG. 7C illustrates the total Sum of thenumber of horizontal lines for each of the second subregions SRB. Fromthis result, the scale region extractor 14 c determines the secondsubregions in which the total numbers of the horizontal lines aregreater than the threshold to be regions (scale regions) in whichgraduations of the meter exist. In the example of FIG. 7C, the scaleregion extractor 14 c determines the positions of the second subregionsSRB1 to SRB6 and SRB9 shown by cross hatching to be the scale region ofthe meter. The scale region extractor 14 c extracts the scale regionfrom the scale area based on this result.

By the processing described above, the region of the candidate region inwhich the graduations exist is designated. The scale region extractor 14c extracts the scale region from the candidate region based on thisresult. For example, as illustrated in FIG. 7D, a scale region R2 isextracted from the candidate region CR1 rotated by the numeral regionextractor 14 a. The scale region extractor 14 c outputs the extractedscale region to the pointer region extractor 14 d.

In the case where a polar transformation of the candidate region hasbeen performed, the scale region extractor 14 c also may perform thefollowing processing.

The scale region extractor 14 c extracts the graduations from the scaleregion. For example, the scale region extractor 14 c identifies thehorizontal lines arranged in the second direction D2 in the scale regionto be graduations. As illustrated in FIG. 8, the scale region extractor14 c calculates a distance D between the graduation Sc and the firstdirection D1 end portion of the candidate region after the polartransformation for each of the graduations Sc. The distances aresubstantially equal when the center of the polar coordinate systemmatches the center of the actual round meter. Fluctuation of thedistance indicates that the center of the polar coordinate system doesnot match the center of the actual round meter.

For example, the scale region extractor 14 c acquires the maximum valueof the distances, the minimum value of the distances, the position ofthe horizontal line at which the distance is the maximum, and theposition of the horizontal line at which the distance is the minimum. Atthe position at which the distance is the minimum, the center of theactual round meter is more distant in the first direction D1 than thecenter of the polar coordinate system. At the position at which thedistance is the maximum, the center of the actual round meter is moreproximate in the first direction D1 than the center of the polarcoordinate system. Based on such information, the scale region extractor14 c corrects the center of the polar coordinate system and re-performsa polar transformation of the candidate region. The scale regionextractor 14 c re-extracts the scale region for the candidate region ofthe new polar transformation. The scale region can be more accuratelyextracted thereby. The reading accuracy of the indication of the metercan be increased.

The processing of the scale region extractor 14 c described in FIGS. 5Ato 8 is for a round meter. Processing similar to that described above isperformed even when the meter is vertical or horizontal. In other words,the scale region extractor 14 c sets the multiple first subregions for acandidate region in which the graduations are arranged in one direction.The scale region extractor 14 c extracts the scale area from thecandidate region based on the total number of the horizontal lines foreach of the first subregions. The scale region extractor 14 c sets themultiple second subregions for the scale area. The scale regionextractor 14 c extracts the scale region from the scale area based onthe total number of the horizontal lines for each of the secondsubregions.

The pointer region extractor 14 d sets a detection region for detectingthe pointer in the candidate region. When the meter is determined to beround by the type determiner 14 b, the pointer region extractor 14 dsets a circular pointer region. When the meter is determined to bevertical or horizontal, the pointer region extractor 14 d sets arectangular pointer region. The pointer region extractor 14 d determinesthe position of the pointer based on information obtained from thedetection region. The pointer region extractor 14 d extracts the pointerregion based on the determination result of the pointer position in thedetection regions while changing the size of the detection region.

An example of the processing by the pointer region extractor 14 d whenthe meter is round will now be described.

First, the pointer region extractor 14 d sets a circular detectionregion. The center of the detection region is set to the center of thecandidate region. First, the diameter of the circle of the detectionregion is set to a predetermined value. The pointer region extractor 14d performs a polar transformation of the detection region. For example,as illustrated in FIG. 9A, a circular detection region DR1 is set in thecandidate region. FIG. 9B illustrates the result of performing the polartransformation of the detection region DR1 illustrated in FIG. 9A andbinarizing. The pointer region extractor 14 d calculates the total ofthe luminances of the multiple pixels arranged in the first direction D1at each of multiple points in the second direction D2 for the detectionregion of the polar transformation. By performing this processing forthe binarized detection region, the number of white pixels arranged inthe first direction D1 is calculated at each of the multiple points inthe second direction D2. FIG. 9C illustrates the relationship betweenthe position P in the second direction D2 and the total Sum of theluminances for the detection region illustrated in FIG. 9B. For example,the pointer region extractor 14 d determines that the pointer exists atthe second direction D2 position at which the total of the luminances isa minimum. When the minimum values of the totals of the luminances arethe same at multiple points, the pointer region extractor 14 d comparesa distribution range threshold and the distribution range of thepositions at which the luminances are minimum values. When thedistribution range is not more than the distribution range threshold,the pointer region extractor 14 d uses the average position as theposition of the pointer. As an example, the second direction D2 distancethat corresponds to an angle of 10 degrees in the polar coordinatesystem is set as the distribution range threshold. The pointer regionextractor 14 d determines the position of the pointer to be undetectedwhen the distribution range is greater than the distribution rangethreshold.

When the pointer position is determined in the detection region that isset, the pointer region extractor 14 d changes the size of the detectionregion. For example, when a small detection region is set first, thepointer region extractor 14 d increases the detection region. FIG. 10Aillustrates another example of the detection region. The diameter of adetection region DR2 illustrated in FIG. 10A is greater than thediameter of the detection region DR1 illustrated in FIG. 9A. FIG. 10Billustrates a result of performing a polar transformation of thedetection region DR2 illustrated in FIG. 10A and binarizing. Similarlyfor the detection region DR2 illustrated in FIG. 10B, the pointer regionextractor 14 d calculates the total of the luminances of the multiplepixels arranged in the first direction D1 at each of multiple points inthe second direction D2. FIG. 10C illustrates the relationship betweenthe position P in the second direction D2 and the total Sum of theluminances for the detection region illustrated in FIG. 10B.

The pointer region extractor 14 d repeats the modification of the sizeof the detection region and the determination of the pointer position inthe detection region described above. This processing is repeated untilthe size of the detection region satisfies a prescribed condition. Forexample, this processing is repeated until the detection region reachesthe scale region. In a typical round meter, at least a portion of thepointer exists inward of the scale region. If the detection regionreaches the scale region, at least a portion of the pointer existsinside the detection region. Or, the processing described above may berepeated until the size of the detection region reaches a designatedvalue calculated based on the size of the candidate region.

FIG. 11 illustrates a result obtained by repeating the modification ofthe size of the detection region and the determination of the pointerposition in the detection region. In FIG. 11, the horizontal axis is asize S of the detection region, and the vertical axis is the position Pof the pointer in the second direction D2. When the meter is round, thesize of the detection region corresponds to the diameter (the radius orthe diameter). The position in the second direction D2 corresponds tothe angle.

From the result of the change of the size of the detection region andthe pointer position, the pointer region extractor 14 d determines afirst range and a second range for the size of the detection region. Thechange of the pointer position is small when the size is within thefirst range. The change of the pointer position is large when the sizeis within the second range. For example, the pointer region extractor 14d calculates the proportion of the change of the pointer position withrespect to the change of the size at each of multiple points of thehorizontal axis for the graph illustrated in FIG. 11. The pointer regionextractor 14 d extracts, as the first range, a continuous portion inwhich the proportion is not more than the first threshold. The pointerregion extractor 14 d extracts, as the second range, a continuousportion in which the proportion is greater than the second threshold.The second threshold is greater than the first threshold.

FIG. 11 illustrates an example of a first range Ra1 and a second rangeRa2. Typically, in a round meter, one end of the pointer is proximate tothe graduations, and the other end of the pointer protrudes to theopposite side of the center of rotation. When the detection region issmall as illustrated in FIGS. 9B and 9C, the total value of theluminances is large at both the position at which the one end of thepointer exists and the position at which the other end exists.Therefore, it is not easy to identify the one end of the pointer withhigh accuracy. As a result, the change of the pointer position is largeas in the second range Ra2 illustrated in FIG. 11. On the other hand,when the detection region is large as illustrated in FIGS. 10B and 10C,the total of the luminances at the position at which the one end of thepointer exists is greater than the total of the luminances at theposition at which the other end exists. Thereby, the one end of thepointer can be discriminated from the other end, and the change of thepointer position is reduced.

The pointer region extractor 14 d determines the size of the pointerregion based on the upper limit of the size (the diameter) of the firstrange. Also, the pointer region extractor 14 d may determine the size ofthe pointer region based on the upper limit of the size in the secondrange or the lower limit of the size (the diameter) in the first range.For example, when the meter is round, a circular-ring shaped pointerregion R3 is extracted as illustrated in FIG. 12. An inner diameter IRof the pointer region R3 is set based on the upper limit of the size inthe second range or the lower limit of the size in the first range. Anouter diameter OR of the pointer region R3 is set based on the upperlimit of the length in the first range. Namely, the pointer region isset so that the length does not include a detection region within thesecond range. The accuracy of the reading of the indication can beincreased thereby.

By the processing described above, the numeral region, the scale region,and the pointer region are extracted from the candidate region. Theextractor 14 outputs the extracted regions to the reader 15.

The reader 15 reads the indication of the meter by using the numeralregion, the scale region, and the pointer region extracted by theextractor 14.

Specifically, the reader 15 includes a graduation recognizer 15 a, anumeral recognizer 15 b, a pointer recognizer 15 c, a graduation joiner15 d, and a calculator 15 e.

The graduation recognizer 15 a recognizes the graduations of the meterbased on the luminance difference in the scale region extracted by theextractor 14. For example, the graduation recognizer 15 a sets areference line and calculates the angles between the reference line andthe graduations.

The numeral recognizer 15 b recognizes a numeral in the numeral regionextracted by the extractor 14. The pointer recognizer 15 c detects theangle between the reference line and the pointer based on information ofthe pointer region extracted by the extractor 14.

The graduation joiner 15 d associates the graduations recognized by thegraduation recognizer 15 a and the numerals recognized by the numeralrecognizer 15 b. The calculator 15 e calculates the indication of themeter based on the angles of the graduations, correspondence informationbetween the graduations and the numerals, and the angle of the pointer.The reader 15 transmits the calculated indication to the outputter 16.

For example, the outputter 16 outputs information based on thecalculated indication to an external output device. For example, theinformation includes the indication that is read. The information mayinclude a result calculated based on the indication that is read. Theoutputter 16 may calculate another value based on the multipleindications that are read and may output the calculation result. Theoutputter 16 also may output information such as the time of thereading, etc. Or, the outputter 16 may output a file including theinformation such as the indication numeral that is read, the time of thereading, etc., in a prescribed format such as CSV, etc. The outputter 16may transmit the data to an external server by using FTP (File TransferProtocol), etc. Or, the outputter 16 may insert the data into anexternal database server by performing database communication and usingODBC (Open Database Connectivity), etc.

The processing device 10 includes, for example, a processing circuitmade of a central processing unit. The memory device 20 includes, forexample, at least one of a hard disk drive (HDD), a network-attachedhard disk (NAS), an embedded multimedia card (eMMC), a solid-state drive(SSD), or a solid-state hybrid drive (SSHD). The processing device 10and the memory device 20 are connected by a wired or wireless technique.Or, the processing device 10 and the memory device 20 may be connectedto each other via a network.

FIGS. 13 to 16 are flowcharts illustrating the processing according tothe reading support system according to the first embodiment.

As illustrated in FIG. 13, the acceptor 11 accepts the input image (stepS11). The contour extractor 12 a extracts contours from the input image(step S12 a). The selector 12 b selects, as candidate regions, a portionof the regions surrounded with the contours that satisfy a condition(step S12 b). The corrector 13 corrects the candidate region byperforming a projective transformation (step S13). The numeral regionextractor 14 a extracts multiple numeral regions from the candidateregion (step S14 a). The type determiner 14 b determines the type of themeter based on the positions of the multiple numeral regions (step S14b). The scale region extractor 14 c extracts the scale region from thecandidate region (step S14 c). The pointer region extractor 14 dextracts the pointer region from the candidate region (step S14 d). Thereader 15 reads the indication of the pointer (step S15). The outputter16 outputs information based on the reading result (step S16).

FIG. 14 is a flowchart specifically illustrating the processing of stepS14 a performed by the numeral region extractor 14 a. The numeral regionextractor 14 a extracts character candidates from the candidate region(step S14 a 1). The numeral region extractor 14 a rotates one of themultiple character candidates (step S14 a 2). The numeral regionextractor 14 a calculates a match rate for the rotated charactercandidate (step S14 a 3). The numeral region extractor 14 a records thecalculated match rate (step S14 a 4). The numeral region extractor 14 adetermines whether or not the rotation count of the character candidateis not more than a threshold (step S14 a 5). Steps S14 a 2 to S14 a 4are repeated when the rotation count is not more than the threshold.When the rotation count is greater than the threshold, the numeralregion extractor 14 a determines whether or not the change amount of thematch rate is not more than a threshold (step S14 a 6). The flowproceeds to step S14 a 8 when the change amount of the match rate is notmore than the threshold. When the change amount of the match rate isgreater than the threshold, the numeral region extractor 14 a determinesa minimum area surrounding the numeral included in the charactercandidate (step S14 a 7). The numeral region extractor 14 a determineswhether or not there is another character candidate for which thenumeral recognition has not been tried (step S14 a 8). When there isanother character candidate, the numeral region extractor 14 a performsstep S14 a 2 for the other character candidate. When there is no othercharacter candidate, the numeral region extractor 14 a extracts theminimum areas determined up to that point as the numeral regions fromthe candidate region (step S14 a 9).

FIG. 15 is a flowchart specifically illustrating the processing of stepS14 c performed by the scale region extractor 14 c. The scale regionextractor 14 c refers to the type of the meter determined by the typedeterminer 14 b and determines whether or not the meter is round (stepS14 c 1). The flow proceeds to step S14 c 3 when the meter is not round.When the meter is round, the scale region extractor 14 c performs apolar transformation of the candidate region (step S14 c 2). The scaleregion extractor 14 c sets multiple subregion columns for the candidateregion (step S14 c 3). The scale region extractor 14 c detectshorizontal lines included in the candidate region (step S14 c 4). Thescale region extractor 14 c calculates the total of the numbers ofhorizontal lines in the subregion columns (step S14 c 5). The scaleregion extractor 14 c may perform steps 14 c 6 and S14 c 7. The scaleregion extractor 14 c uses the maximum value of the totals of thenumbers of horizontal lines as a score, and determines whether or notthe score is greater than a threshold (step S14 c 7). When the score isnot more than the threshold, there is a possibility that the horizontallines cannot be appropriately detected. The scale region extractor 14 cmodifies the detection condition of the horizontal lines and re-performsstep S14 c 4.

When the score is greater than the threshold, the scale region extractor14 c determines whether or not the resolution is not more than athreshold (step S14 c 8). For example, the resolution is represented bythe proportion of the size of one first subregion to the size of theentire extraction region. When the resolution is greater than thethreshold, the scale region extractor 14 c modifies the settingcondition of the first subregion and re-performs step S14 c 3. When theresolution is not more than the threshold, the scale region extractor 14c extracts the scale area from the candidate region based on the totalof the numbers of horizontal lines in each of the first subregions (stepS14 c 8).

The scale region extractor 14 c sets multiple second subregions for thescale area (step S14 c 9). The scale region extractor 14 c detectshorizontal lines included in the scale area (step S14 c 10). The scaleregion extractor 14 c calculates the total of the numbers of horizontallines in the second subregion (step S14 c 11). The scale regionextractor 14 c may perform steps S14 c 12 and S14 c 13. The scale regionextractor 14 c uses the maximum value of the totals of the numbers ofhorizontal lines as a score, and determines whether or not the score isgreater than a threshold (step S14 c 12). When the score is not morethan the threshold, there is a possibility that the horizontal linescannot be appropriately detected. The scale region extractor 14 cmodifies the detection condition of the horizontal lines and re-performsstep S14 c 10. When the score is greater than the threshold, the scaleregion extractor 14 c determines whether or not the resolution is notmore than the threshold (step S14 c 13). When the resolution is greaterthan the threshold, the scale region extractor 14 c modifies the settingcondition of the second subregion and re-performs step S14 c 9. When theresolution is not more than the threshold, the scale region extractor 14c extracts the scale region from the scale area based on the total ofthe numbers of horizontal lines in each of the second subregions (stepS14 c 14).

FIG. 16 is a flowchart specifically illustrating the processing of stepS14 d performed by the pointer region extractor 14 d. The pointer regionextractor 14 d sets a detection region in the candidate region (step S14d 1). The pointer region extractor 14 d determines the position of thepointer in the detection region that is set (step S14 d 2). The pointerregion extractor 14 d records the determined position of the pointer(step S14 d 3). The pointer region extractor 14 d determines whether ornot the detection region satisfies a condition (step S14 d 4). Forexample, the pointer region extractor 14 d determines whether or not thedetection region reaches (overlaps) the scale region. When the detectionregion does not satisfy the condition, the pointer region extractor 14 dmodifies the length in a designated direction of the detection region(step S14 d 5). The pointer region extractor 14 d re-performs step S14 d2 based on the detection region having the modified length. When thedetection region satisfies the condition, the pointer region extractor14 d extracts the pointer region from the candidate region based on therelationship between the change of the length and the change of thepointer position (step S14 d 6).

Effects of the first embodiment will now be described.

When reading the indication of the meter from the image, processing thatcorresponds to the type of the meter is performed on the image. This isbecause the arrangement of the graduations is different according to thetype of the meter as illustrated in FIGS. 2A to 2D. By performing theprocessing corresponding to the type of the meter, the accuracy of thereading of the indication can be increased.

For example, a method in which the type of the meter to be imaged ispreregistered may be considered to perform the processing correspondingto the type of the meter. The processing device 10 determines theprocessing to be performed by referring to the registered type of themeter. However, in this method, the indication cannot be appropriatelyread if the type of the meter is not preregistered. When sequentiallyreading indications from images of multiple mutually-different meters,etc., it is necessary to associate the meters imaged the images and thetypes of the meters, and a long period of time is necessary for thesetting beforehand.

In the reading support system 1 according to the first embodiment,first, the numeral region extractor 14 a extracts numeral regionsincluding multiple numerals of the meter from the candidate region.Then, the type determiner 14 b determines the type of the meter based onthe positions of the multiple numeral regions. In other words, accordingto the reading support system 1 according to the first embodiment, thetype of the meter is determined automatically from the image. By usingthe reading support system 1, it is unnecessary for the user topreregister the type of the meter for reading the indication.

Other effects of the first embodiment will now be described.

The numeral region, the scale region, and the pointer region areextracted from the candidate region when reading the indication of themeter from the image. Then, the indication of the meter is read based onthese extracted regions. At this time, it is desirable for the numeralregion, the scale region, or the pointer region to be more appropriatelyextracted. By more appropriately extracting the numeral region, thescale region, or the pointer region, the indication can be read withhigher accuracy.

For example, there is a method in which the position of the meter wherethe graduations exist is preregistered, and the scale region isextracted from the candidate region based on the registered informationand the luminance of the image. However, in this method, the scaleregion cannot be appropriately extracted when the actual scale region isdifferent from the registered position. When sequentially reading theindications from the images of multiple mutually-different meters, etc.,it is necessary to associate the meters of the images and the positionsof the graduations in the meters, and a long period of time is necessaryfor the setting beforehand.

In the reading support system 1 according to the first embodiment, thescale region extractor 14 c performs the following processing.

The scale region extractor 14 c sets multiple first subregions in thesecond direction in the candidate region so that multiple firstsubregions are arranged in the first direction. The scale regionextractor 14 c detects the number of line segments extending in thesecond direction for each of the first subregions. The scale regionextractor 14 c extracts a portion in the second direction of thecandidate region as the scale area in which the graduations of the meterexist based on the detected numbers of the line segments.

According to the processing, it is unnecessary to preregister theposition of the scale region of the meter, and the area in whichgraduations exist can be extracted more appropriately from the candidateregion. Therefore, it is unnecessary for the user to preregister thepositions of the graduations of the meters for reading the indication.By more appropriately extracting the scale area, the accuracy of thereading of the indication using the scale area can be increased.

In the reading support system 1, the scale region extractor 14 c alsoperforms the following processing.

The scale region extractor 14 c sets multiple second subregions in thefirst direction for the scale area so that the multiple secondsubregions are arranged in the second direction. The scale regionextractor 14 c detects the number of line segments extending in thesecond direction for each of the second subregions. Based on thedetected numbers of the line segments, the scale region extractor 14 cextracts a portion in the first direction of the scale area as the scaleregion in which the graduations of the meter exist.

By performing such processing after extracting the scale area, theregion in which the graduations exist can be extracted with higheraccuracy from the scale area. For example, by using the scale region toread the indication, the accuracy of the reading can be increased.

In the reading support system 1 according to the first embodiment, thepointer region extractor 14 d performs the following processing.

When the type of the meter is round, the pointer region extractor 14 dsets a circular detection region for detecting the pointer of the meterin the candidate region. The pointer region extractor 14 d changes thesize of the detection region and determines the angle of the pointer inthe detection region of each size, and extracts the pointer region inwhich the pointer exists from the candidate region based on the resultof the determination. According to the processing, it is unnecessary topreregister the position of the pointer region of the meter, and thepointer region can be extracted more appropriately from the candidateregion.

In particular, the pointer region extractor 14 d determines the firstand second ranges for the size from the result of the change of theangle with respect to the change of the size. Then, the pointer regionextractor 14 d extracts a circular-ring shaped pointer region having anouter diameter based on the upper limit of the first range and an innerdiameter based on the upper limit of the second range. According to thisprocessing, the regions that have little contribution to the recognitionof the pointer can be excluded from the pointer region. The accuracy ofthe reading can be increased by using the pointer region extracted bythis processing to read the indication.

Second Embodiment

FIG. 17 is a block diagram illustrating a configuration of a readingsupport system according to a second embodiment.

The reading support system 2 according to the second embodiment furtherincludes an imaging device 30. The imaging device 30 generates an imageby imaging the meter. The imaging device 30 transmits the generatedimage to the processing device 10. Or, the imaging device 30 may storethe image in the memory device 20. The processing device 10 accesses thememory device 20 and refers to the stored image. When the imaging device30 acquires a video image, the imaging device 30 extracts a static imagefrom the video image and transmits the static image to the processingdevice 10. The imaging device 30 includes, for example, a camera.

The processing device 10 transmits, to an output device 40, informationbased on characters that are identified and read. The output device 40outputs the information received from the processing device 10 so thatthe user can recognize the information. The output device 40 includes,for example, at least one of a monitor, a printer, or a speaker.

For example, the processing device 10, the memory device 20, the imagingdevice 30, and the output device 40 are connected to each other by awired or wireless technique. Or, these devices may be connected to eachother via a network. Or, two or more of the processing device 10, thememory device 20, the imaging device 30, or the output device 40 may beembedded in one device. For example, the processing device 10 may beembedded in an integral body with the image processor of the imagingdevice 30, etc.

Third Embodiment

FIG. 18 is a block diagram illustrating a configuration of a readingsupport system according to a third embodiment.

The reading support system 3 according to the third embodiment furtherincludes a moving body 50. The moving body 50 moves through a prescribedarea. A meter is provided inside the area through which the moving body50 moves. The moving body 50 is, for example, an automated guidedvehicle (AGV). The moving body 50 may be a flying object such as adrone, etc. The moving body 50 may be an independent walking robot. Themoving body 50 may be an unmanned forklift, crane, or the like thatperforms a prescribed operation.

For example, the processing device 10 and the imaging device 30 aremounted to the moving body 50. The processing device 10 may be providedseparately from the moving body 50 and may be connected to the movingbody 50 via a network. When the moving body 50 moves to a position wherethe meter is imagable, the imaging device 30 generates an image byimaging the meter.

As illustrated in FIG. 18, the reading support system 3 may furtherinclude an acquisition device 60. The acquisition device 60 is mountedto the moving body 50. For example, an identifier that includes uniqueidentification information corresponding to the meter is provided. Theacquisition device 60 acquires the identification information of theidentifier.

As illustrated in FIG. 18, the reading support system 3 may furtherinclude a control device 70. The control device 70 controls the movingbody 50. The moving body 50 moves through the prescribed area based on acommand transmitted from the control device 70. The control device 70may be mounted to the moving body 50 or may be provided separately fromthe moving body 50. The control device 70 includes, for example, aprocessing circuit made of a central processing unit. One processingcircuit may function as both the processing device 10 and the controldevice 70.

For example, the identifier is a radio frequency (RF) tag including IDinformation. The identifier emits an electromagnetic field or a radiowave including the ID information. The acquisition device 60 acquiresthe ID information by receiving the electromagnetic field or the radiowave emitted from the identifier.

Or, the identifier may be a one-dimensional or two-dimensional barcode.The acquisition device 60 may be a barcode reader. The acquisitiondevice 60 acquires the identification information of the barcode byreading the barcode.

As illustrated in FIG. 18, the processing device 10 may further includean associator 17. For example, when acquiring the identificationinformation, the acquisition device 60 transmits the identificationinformation to the processing device 10. The associator 17 associatesthe transmitted identification information and the characters that areread. The associated information is stored in the memory device 20.

FIG. 19 is a schematic view describing an operation of the readingsupport system according to the third embodiment.

For example, the moving body 50 is a moving body moving along aprescribed trajectory T. The imaging device 30 and the acquisitiondevice 60 are mounted to the moving body 50. The processing device 10may be mounted to the moving body 50 or may be provided separately fromthe moving body 50. The trajectory T is provided so that the moving body50 passes in front of meters M11 and M12.

For example, the moving body 50 moves along the trajectory T anddecelerates or stops when arriving at a position where the meter M11 orM12 is imagable by the imaging device 30. For example, when deceleratingor stopping, the moving body 50 transmits an imaging command to theimaging device 30. Or, the imaging command may be transmitted to theimaging device 30 from the control device 70. When receiving thecommand, the imaging device 30 images the meter M11 or M12 while themoving body 50 has decelerated or stopped.

Or, the moving body 50 moves along the trajectory T at a speed such thatthe imaging device 30 can image the meter M11 or M12 without blur. Whenthe position where the meter M11 or M12 is imagable by the imagingdevice 30 is reached, the imaging command is transmitted from the movingbody 50 or the control device described above. When receiving thecommand, the imaging device 30 images the meter M11 or M12. When theimage has been generated by imaging, the imaging device 30 transmits theimage to the processing device 10 mounted to the moving body 50 orprovided separately from the moving body 50.

An identifier ID1 is provided at the meter M11 vicinity. An identifierID2 is provided at the meter M12 vicinity. For example, the acquisitiondevice 60 acquires the identification information of the identifier ID1or ID2 while the moving body 50 has decelerated or stopped.

For example, the moving body 50 moves in front of the meter M11. Theimaging device 30 generates an image by imaging the meter M11. Theprocessing device 10 identifies the characters displayed by the meterM11 from the image. The acquisition device 60 acquires theidentification information of the identifier ID1 corresponding to themeter M11. The processing device 10 associates the identificationinformation and the identified characters.

The processing of the processing device 10 is particularly favorablewhen the imaging device 30 is mounted to the moving body 50 andsequentially images multiple meters as illustrated in FIG. 19. Becausethe type of the meter is determined automatically by the numeral regionextractor 14 a and the type determiner 14 b, it is unnecessary for theuser to preregister the type of the meter.

There is also a possibility that fluctuation of the image may occuraccording to the state of the moving body 50. The numeral region, thescale region, and the pointer region are extracted automatically fromthe candidate region by the numeral region extractor 14 a, the scaleregion extractor 14 c, and the pointer region extractor 14 d accordingto the processing by the processing device 10 even when fluctuationoccurs in the image. Therefore, the accuracy of the reading of theindication can be increased.

FIG. 20 is a block diagram illustrating a hardware configuration of thereading support systems according to the embodiments.

For example, the processing device 10 of the reading support systems 1to 3 is a computer and includes ROM (Read Only Memory) 10 a, RAM (RandomAccess Memory) 10 b, a CPU (Central Processing Unit) 10 c, and a HDD(Hard Disk Drive) 10 d.

The ROM 10 a stores programs controlling the operations of the computer.The ROM 10 a stores programs necessary for causing the computer tofunction as the controller 10.

The RAM 10 b functions as a memory region where the programs stored inthe ROM 10 a are loaded. The CPU 10 c includes a processing circuit. TheCPU 10 c reads a control program stored in the ROM 10 a and controls theoperation of the computer according to the control program. The CPU 10 cloads various data obtained by the operation of the computer into theRAM 10 b. The HDD 10 d stores information necessary for reading andinformation obtained in the reading process. For example, the HDD 10 dfunctions as the memory device 20 illustrated in FIG. 1.

Instead of the HDD 10 d, the controller 10 may include an eMMC (embeddedMulti Media Card), a SSD (Solid State Drive), a SSHD (Solid State HybridDrive), etc.

An input device 10 e and an output device 10 f may be connected to thecontroller 10. The user uses the input device 10 e to input informationto the controller 10. The input device 10 e includes at least one of amouse, a keyboard, a microphone (audio input), or a touchpad.Information that is transmitted from the controller 10 is output to theoutput device 10 f. The output device 10 f includes at least one of amonitor, a speaker, a printer, or a projector. A device such as a touchpanel that functions as both the input device 10 e and the output device10 f may be used.

A hardware configuration similar to FIG. 20 is applicable also to thecontrol device 70 of the reading support system 3. Or, one computer mayfunction as the processing device 10 and the control device 70 in thereading support system 3. The processing and the functions of theprocessing device 10 and the control device 70 may be realized bycollaboration between more computers.

The embodiments may include the following configurations.

Configuration 1

A moving body moving through a prescribed area, the moving bodycomprising:

an imaging device acquiring an image by imaging a meter; and

a processing device receiving an input of the image,

the processing device including

-   -   an extractor extracting a candidate region from the image, the        candidate region being a candidate of a region in which a meter        is imaged, and    -   a scale region extractor that:        -   sets multiple subregion columns in a second direction            perpendicular to a first direction for a candidate region,            the candidate region being a candidate of a region in which            a meter is imaged, each of the subregion columns including a            plurality of subregions arranged in the first direction;        -   detects a number of line segments extending in the second            direction for each of the subregions; and        -   extracts, based on the detected numbers of the line            segments, a portion in the second direction of the candidate            region as a scale area in which a graduation of the meter            exists.            Configuration 2

The moving body according to Configuration 1, wherein

the scale region extractor:

-   -   sets multiple subregion rows in the first direction for the        scale area, each of the subregion rows including a plurality of        second subregions arranged in the second direction;    -   detects a number of line segments extending in the second        direction for each of the second subregions; and    -   extracts, based on the detected numbers of the line segments, a        portion in the first direction of the scale area as a scale        region in which a graduation of the meter exists.        Configuration 3

A reading support method, comprising:

extracting a plurality of characters from a candidate region, thecandidate region being a candidate of a region in which a meter isimaged;

calculating match rates between a numeral and each of the plurality ofcharacters while rotating the plurality of characters;

determining, as a plurality of numerals of the meter, at least a portionof the plurality of characters of which the match rate is not less thana prescribed threshold;

extracting a plurality of numeral regions respectively including theplurality of numerals from the candidate region; and

determining a type of the meter based on positions of the plurality ofnumeral regions.

Configuration 4

A reading support method, comprising:

setting a plurality of subregion columns in a second directionperpendicular to a first direction for a candidate region, the candidateregion being a candidate of a region in which a meter is imaged, each ofthe subregion columns including a plurality of first subregions arrangedin the first direction;

detecting a number of line segments extending in the second directionfor each of the first subregions; and

extracting, based on the detected numbers of the line segments, aportion in the second direction of the candidate region as a scale areain which a graduation of the meter exists.

Configuration 5

A storage medium storing a program causing a processing device tofunction as:

a numeral region extractor extracting a plurality of numeral regionsfrom a candidate region, the candidate region being a candidate of aregion in which a meter is imaged, the plurality of numeral regionsrespectively including a plurality of numerals of the meter; and

a type determiner determining a type of the meter based on positions ofthe plurality of numeral regions.

Configuration 6

A storage medium storing a program causing a processing device tofunction as a scale region extractor that:

sets a plurality of subregion columns in a second directionperpendicular to a first direction for a candidate region, the candidateregion being a candidate of a region in which a meter is imaged, each ofthe subregion columns including a plurality of first subregions arrangedin the first direction;

detects a number of line segments extending in the second direction foreach of the first subregions; and

extracting, based on the detected numbers of the line segments, aportion in the second direction of the candidate region as a scale areain which a graduation of the meter exists.

By using the reading support system, the reading support method, and themoving body according to the embodiments described above, the numeralsdisplayed by the meter can be read with higher accuracy. Similarly, byusing a program for causing a computer to operate as the reading supportsystem, the numerals displayed by the meter can be read by the computerwith higher accuracy.

For example, the processing of the various data recited above isexecuted based on a program (software). For example, the processing ofthe various information recited above is performed by a computer storingthe program and reading the program.

The processing of the various information recited above may be recordedin a magnetic disk (a flexible disk, a hard disk, etc.), an optical disk(CD-ROM, CD-R, CD-RW, DVD-ROM, DVD±R, DVD±RW, etc.), semiconductormemory, or another recording medium as a program that can be executed bya computer.

For example, the information that is recorded in the recording mediumcan be read by a computer (or an embedded system). The recording format(the storage format) of the recording medium is arbitrary. For example,the computer reads the program from the recording medium and causes aCPU to execute the instructions recited in the program based on theprogram. The acquisition (or the reading) of the program by the computermay be performed via a network.

The processing device and the control device according to theembodiments include one or multiple devices (e.g., personal computers,etc.). The processing device and the control device according to theembodiments may include multiple devices connected by a network.

While certain embodiments have been described, these embodiments havebeen presented by way of example only, and are not intended to limit thescope of the inventions. Indeed, the novel embodiments described hereinmay be embodied in a variety of other forms; furthermore, variousomissions, substitutions and changes in the form of the embodimentsdescribed herein may be made without departing from the spirit of theinventions. The accompanying claims and their equivalents are intendedto cover such forms or modifications as would fall within the scope andspirit of the invention. The above embodiments can be practiced incombination with each other.

What is claimed is:
 1. A reading support system, comprising: aprocessing device including an extractor extracting a plurality ofregions from a candidate region, the candidate region being a candidateof a region in which a meter is imaged, the plurality of regionsrespectively including a plurality of characters of the meter, and atype determiner determining a type of the meter based on positions ofthe plurality of regions.
 2. The reading support system according toclaim 1, wherein the extractor includes a numeral region extractor, andthe numeral region extractor extracts a plurality of numeral regions, asthe plurality of regions, respectively including a plurality ofnumerals.
 3. The reading support system according to claim 2, whereinthe numeral region extractor: extracts a plurality of characters fromthe candidate region; calculates match rates between a numeral and eachof the plurality of characters while rotating the plurality ofcharacters; and extracts, as the plurality of numeral regions of themeter, at least a portion of the plurality of characters of which thematch rate is not less than a prescribed threshold.
 4. The readingsupport system according to claim 2, wherein the type determinerdetermines the type of the meter to be round when the plurality ofnumerals is arranged in a curve, and determines the type of the meter tobe vertical or horizontal when the plurality of numerals is arrangedalong one direction.
 5. The reading support system according to claim 2,wherein the extractor further includes a scale region extractor that:sets a plurality of subregion columns in a second directionperpendicular to a first direction for the candidate region, each of thesubregion columns including a plurality of first subregions arranged inthe first direction; detects a number of line segments extending in thesecond direction for each of the first subregions; and extracts, basedon the detected numbers of the line segments, a portion in the seconddirection of the candidate region as a scale area in which a graduationof the meter exists.
 6. The reading support system according to claim 5,wherein the scale region extractor: sets a plurality of subregion rowsin the first direction for the scale area, each of the subregion rowsincluding a plurality of second subregions arranged in the seconddirection; detects a number of line segments extending in the seconddirection for each of the second subregions; and extracts, based on thedetected numbers of the line segments, a portion in the first directionof the scale area as a scale region in which a graduation of the meterexists.
 7. The reading support system according to claim 6, furthercomprising: a corrector performing at least a projective transformationof the candidate region, the numeral region extractor extracting thenumeral regions from the candidate region of the projectivetransformation, the scale region extractor extracting the scale regionfrom the candidate region of the projective transformation.
 8. Thereading support system according to claim 6, wherein the numeral regionextractor outputs the positions of the plurality of numeral regions tothe corrector, the corrector re-performs a projective transformation ofthe candidate region based on the positions of the plurality of numeralregions, the numeral region extractor extracts the numeral regions fromthe candidate region of the re-performed projective transformation, andthe scale region extractor extracts the scale region from the candidateregion of the re-performed projective transformation.
 9. The readingsupport system according to claim 6, wherein when the type of the meteris round, the scale region extractor performs at least a polartransformation of the candidate region and extracts the scale area andthe scale region from the candidate region of the polar transformation.10. The reading support system according to claim 9, wherein the scaleregion extractor: corrects a center of a polar coordinate system of thepolar transformation to approach a center of the meter by using agraduation of the meter in the scale area or the scale region;re-performs a polar transformation of the candidate region based on thecorrected center of the polar coordinate system; and extracts the scalearea and the scale region from the candidate region of the re-performedpolar transformation.
 11. The reading support system according to claim6, wherein the processing device further includes a reader reading anindication of the meter based on the extracted numeral regions and theextracted scale region.
 12. The reading support system according toclaim 2, wherein the processing device further includes a pointer regiondetector that: sets a detection region in the candidate region to becircular when the type of the meter is round, the detection region beingfor detecting a pointer of the meter; changes a size of the detectionregion and determines an angle of the pointer for the detection regionfor each of the sizes; and extracts, from the candidate region, apointer region in which the pointer exists based on a result of a changeof the angle with respect to the change of the size.
 13. The readingsupport system according to claim 12, wherein the pointer regiondetector: determines, from the result of the change of the angle withrespect to the change of the size, a first range of the size in whichthe change of the angle is not more than a first threshold, and a secondrange of the size in which the change of the angle is not less than asecond threshold, the second threshold being greater than the firstthreshold; and extracts the pointer region having a circular ringconfiguration, the circular ring configuration having an outer diameterbased on an upper limit of the first range and having an inner diameterbased on an upper limit of the second range.
 14. The reading supportsystem according to claim 1, further comprising: an imaging deviceacquiring an image by imaging the meter, the image including thecandidate region.
 15. The reading support system according to claim 14,wherein the imaging device images a video image in which the meter isimaged, and cuts out the image from the video image.
 16. The readingsupport system according to claim 14, further comprising: a moving bodymoving through a prescribed area and having the imaging device mountedto the moving body.
 17. A reading support system, comprising: aprocessing device including a scale region extractor that: sets aplurality of subregion columns in a second direction perpendicular to afirst direction for a candidate region, the candidate region being acandidate of a region in which a meter is imaged, each of the subregioncolumns including a plurality of first subregions arranged in the firstdirection; detects a number of line segments extending in the seconddirection for each of the first subregions; and extracts, based on thedetected numbers of the line segments, a portion in the second directionof the candidate region as a scale area in which a graduation of themeter exists, wherein the scale region extractor: sets a plurality ofsubregion rows in the first direction for the scale area, each of thesubregion rows including a plurality of second subregions arranged inthe second direction; detects a number of line segments extending in thesecond direction for each of the second subregions; and extracts, basedon the detected numbers of the line segments, a portion in the firstdirection of the scale area as a scale region in which a graduation ofthe meter exists.
 18. The reading support system according to claim 17,further comprising: an imaging device acquiring an image by imaging themeter, the image including the candidate region.
 19. The reading supportsystem according to claim 18, wherein the imaging device images a videoimage in which the meter is imaged, and cuts out the image from thevideo image.
 20. The reading support system according to claim 18,further comprising: a moving body moving through a prescribed area andhaving the imaging device mounted to the moving body.
 21. A moving bodymoving through a prescribed area, the moving body comprising: an imagingdevice acquiring an image by imaging a meter; and a processing devicereceiving an input of the image, the processing device including anextractor extracting a candidate region from the image, the candidateregion being a candidate of a region in which a meter is imaged, anumeral region extractor extracting a plurality of numeral regions fromthe candidate region, a plurality of numerals of the meter beingpositioned in the numeral region, and a type determiner determining atype of the meter based on positions of the plurality of numeralregions.
 22. The moving body according to claim 21, wherein the imagingdevice images a video image in which the meter is imaged, and cuts outthe image from the video image.